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ABSTRACT 

In Pennsylvania compliance with state health and 
safety regulations for day care center licensing is monitored by 
administering the Child Development Program Evaluation (CDPE). This 
pilot study attempted to discover key indicators of day care center 
quality other than those measured on the CDPE and also to find out 
about the relationships between these quality indicators and child 
development. Ten day care centers were assessed using the CDPE and 
two other measures, the Early Childhood Environmental Rating Scale 
(ECERS) and the Caregiver Observation Form and Scale. Results 
indicated that nonprofit centers had higher scores on the two 
measures of quality than profit centers. However, children who 
attended profit centers had higher socioeconomic status and higher 
scores for cognitive, language, and social development. After a 
certain level of state compliance, program quality scores were found 
to fall as state compliance scores rose. A hierarchical multiple 
regression analysis to determine the predictors of child development 
revealed only one small effect for program quality. Ten items from 
the ECERS were found to be good predictors of overall program 
quality. It was concluded that compliance with state regulations is 
not an indicator of program quality, and that a comprehensive, 
state-wide study of day care quality should obtain separate samples 
of profit and nonprofit centers, should include lower ard middle 
class children from each center, and should explore funding as a 
factor in day care quality. (CB) 
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Introduction 

Pennsylvania is one of a handful of states that still 
requires compliance with state regulations in order for day care 
centers to be licensed. Compliance with state regulations is 
monitored by annually administering a 27G-item instrument known as 
the Child Development Program Evaluation (CDPE) that is designed 
to determine compliance with basic health and safety requirements 
as well as program criteria. Pennsylvania is committed to the use 
cf the CD*E because it is an objective, reliable, cost efficient 
nethod of assessing compliance, but also because the Office of 
Children, Youth, and Families (QCYF) wants to assure that day care 
providers pro* • *e child development (Fiene k Nixon, 1981). The 
assumption OCYF must make is that higher compliance as measured by 
the CDPE is related to enhanced children's development and vice 
versa. No empirical support for that assumption has been 
available, however. Thus, there has been a clear need for 
research . 

Th--? impetus for such research has recently come about in 
several farms. For one, the i nst rument -based program monitoring 
-system represented by the CDPE has resulted in a "ceiling effect" 
wi + h respect to compliance to day care licensing regulations. 
Nearly 97% compliance to state regulations was obtained within 
i»j=it a -few short years after the system was implemented. Second, 
r1*v r.? r e centers are now required to apply to and be accepted by 
♦ h» st?*? as ••vendors" of subsidized child care slots. Consistent 
with its qnal of promoting child development, OCYF would like to 
' now *:h«3t vendors selected to provide subsidized day care are 
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centers of high quality. However, since the CDPE focuses primarily 



are in compliance with those requirements, the state has no way of 

objectively discriminating among centers that are providing higher 
versus lower qualitv day care services. Knowledge of Uey quality 
indicators other than health and safety features is needed as is 
knowledge about the relationship between such quality indicators 
and children's development. Such knowledge could then be 
translated into public policy concerning regulation and funding in 
day care. To provide such knowledge, a pilot study using just ten 
day care centers was conducted between July and September, 1984 in 
the northeast region of Pennsylvania. 



The pilot study was designed withythe currently available 
literature on day care and day care quality in mind. The issue of 
variations in day care quality and its influence on children has 
only rarely been addressed empirically. In most studies concerning 
day care, it has been treated as a dichotomous variable - a 
homogeneous experience that is present oV absent in a. child's life 
- rather than as a mul t i -d imensional environment that can vary 
along a wide continuum for each dimension (Belsky & Steinberg, 
1»?7) , Tn -fact, research shows that day care environments are 
hct.-?roq^neous and that differences in these environments may 
produce differences in children (Macrae k Herbert-Jackson, 1975). 

Only three studies have examined the relationship between 
quality of the day care environment and the development of 
children cared for in those environments. In spite of the 
inconsistencies in these three studies, the results were 



an health and safety requirements, and since 97% of the centers 
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consistent. Higher quality day care environments were related to 
level of children's intellectual, language, and social development 
(McCartney, Scarr, Phillips, Grajek, fcSchwarz, 19S2)i to more 
positive adult-child interaction aqd less solitary play and 
aimless wandering (Vandell tc Powers, 1933)5 and to positive 
classroom behaviors (e.g. more cooperation, verbal initiatvej less 
aggression and aimlessness) and superior test score gains (Ruopp, 
1979). In sum, results of available research support a positive 
relationship between day care quality and child development and 
generate concern about the need tor regulation of day care 
centers. 

In light of the above concerns, the present pilot study was 
conducted so that ultimately day care regulations can be designed 
to promote children's development and to support families and 
childrearing rather than just to maintain minimal standards o-f 
care. The eventual outcome of the pilot study will hopefully be 
the evaluation and mudificaticn of public policy concerning day 
care regulations and their influence en children's development. 
Due tc limitations in resources, however, the more immediate goal 
of the pilot study was to obtain preliminary data tc support a 
federal grant proposal addressing the. day care quality issue, 
flcquisi t ion of federal funding will allow a state-wide, 
comprehensive study of day care qual'ty and child development that 
i t> designed to inform public policy. Because of the pilot study, 
federal funding is more- liUely and the probability of a successful 
comprehensive study is higher. 
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■ Center Demographies and Quality 

Prof 1 1 /Npnp roll t. 0+ the ten centers participating in, this 
project, six were nonprofit and four were profit centers. When a 
dichotomous profit/nonprofit variable was included in a 
correlation matrix with other variables related to center 
characteristics and child development outcomes, it was discovered 
that profit/nonprofit status correlated with the program quality 
measures (r = .60 with ECERS ar.d r = .20 with COFAS) . Further 
examination revealed that there were no differences between profit 
ard nonprofit centers on CDPE score's. However, nonprofit centers 
had significantly higher CQFAS scores (M * 73.66 -for nonprofit and 
59.75 -for profit) as well as significantly higher ECERS scores (M 
189. 33 for nonprofit and 152.25 lor profit). These results were 
surprising and totally unexpected since all centers had 
volunteered to participate following an invitation. Records on 
sample selection revealed that more profit centers declined 
invitations to participate than did nonprofit centers. Both of 
these facts would lead one to believe that there would be 
homoqeneity of quality and a tendency towards uniformly higher 
quality than a randomly selected sample. Thus, the discrepancies 
in measures of quality found between profit and nonprofit centers 
qre of particular concern. 

Cert e r_SeJ.ec t ^on .b^Parents. Not surprisingly, there were 
differences found between the parent clientele of profit versus 
nonprofit centers. Parents who select profit centers were more 
highly educated and earn more money. These socioeconomic 
differences were related to differences in the development of 
children attending profit and nonprofit centers. Children in 
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pro-fit centers were more likely to be products of middle and 
upper-middle class families and thus, predictably, exhibited 
higher scores for cognitive, language, and social development. 
While these$<rcenter selection differences are to be expected, the 
discrepancies in quality between profit and nonprofit centers 
complicate the interpretation of the data collected. In other 
words, when the higher quality centers enroll the children with 
lcwer cognitive, language, and social development (and vice 
versa), it is difficult to tell how day care quality alone affects 
children's development since socioeconomic status is such an* 
important intervening variable. 

C eili na_E f f e c t _£ o r _CDPE/£JDF£S . One result of interest from 
the pilot study was the relationship between program quality as 
measured by the ECERS and level of program compliance with state 
day care regulations (as measured by the CDPE and COFAS) . 
Correlations revealed that there was no relationship between the 
ECERS total score and CDPE-IC score (computed as proportion of 
items in compliance). However, there was a very restricted range 
rf CDPE scores of only 20 points (30% to 100% compliance). The 
cnr relat ion between the ECERS tutal score and the COFAS was .20, 
-at^er small and lacking in statistical significance. The COFAS 
range was from 54 to SI points. In a state where compliance to 
stnt^ day rare regulations is 97%, there is little room for the 
variation required for there to be a statistically significant 
relationship between program quality and program compliance (this 
1 f- called a ceiling effect). 

The fact that a linear relationship between program quality 
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and program compliance does not exist does not preclude a 
nonlinear relationship b< '•ween the two. fable a and Figure 1 (see 
attached) each depict the relationship betwec am quality and 

program compliance. It is easy to s«e that the relationship 
between these two variables is much more curvi 1 inear than 1 inear. 
This -Fact .^mbined with the high level of compliance explain the 
Jack of correlations between program quality and program 
romp 1 i ance . 

The existence of a curvilinear relationship could be 
explained in the -Following manner; as programs move from low 
levels of compliance to substantial compliance, they do improve in 
quality? however, as the programs nove from substantial compliance 
tn ful' compliance they do not necessarily improve in program 
quality. In high quality programs, there may be a compliance 
"pleteau." In fact, there is speculation that higher quality 
programs actually forego full compliance in order to devote their 
energies to what they perceive to be more relevant program quality 
conrpr ns. 

In order to find out how variations in day care quality 
affect children's development, a hierarchical multiple regression 
was used. This means that a four-step process of determining 
predictors of children's development was implemented. At each 
*5tep, the amount of variance in children's cognitive, language, 
and social development accounted for by the predictors was 
ralculated. Then as predictors were added to the model, it was 
c\lso possible to determine how much additional variance had been 
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ECERS = Early Childhood Environmental Rating Scale (Harms $ Clifford) 
CDPE ■ Child Development Program Evaluation (Fiene, Douglas § Kroh) 
COFAS = Caregiver Observation Form and Scale (Fiene) 

> 





CDPE/COFAS 


ECERS 




Full 

Compl iance 


174* 
(174-173)** 


169* 
(190-151)** 


Medium 
Qual i ty 


Substantial 
Compl iance 


161 
(162-158) 


178 
(206-140) 


High 
Qual i ty 


Low 

Compl iance 


141 

(148-135) 


148 
(186-119) 


Low 

Quality 



■'A 



* = average 
** = range 



Table 1 

Comparison of CDPE/CDFAS and ECERS Scores 
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Graphic representation depicting the curvilinear relationship between 
Compliance with Pennsylvania State Child Day Care Regulations (as measured' 
by the CDPE/COFAS) and program quality (as measured by the ECERS) . 



Figure 1 
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accounted -for by the newly included predictors, fror the first 



children's cognitive, language, and social development. Then 
f ami ly background variables -found to influence center selection 
were added to -form step 2 (those variables were: presence of the 
•father in the home, whether or not the child was subsidized, and 
amount of home stimulation). Step three involved adding t»*o 
vaM^bles concerned with the 0 child's substitute care history (age 
at entry into group care and length of time in group care). This 
step estimates the effects of just exposure -„o day care, separate 
frcm the quality of the environment. Finally, measures of the 
quality of the day care environment were added to the model. (Ecers 
total* CDPE-IC, COFAS) to estimate the effects of day care 
cjual i ty . 

Results of the hierarchical multiple regression revealed that 
in only one instance did day care quality add significantly to the 
amount nf variance that accounted for children's development. 
Center quality was a significant factor in predicting children's 
scores on the Preschool Behavior Questionnaire, a measure of 
children's behavior problems. More specifically, 20% of the 
variance cf children's behavior problems could be accounted for by 
renter quality. In fact, it was the CDPE score that made the 
differer.ee. Centers with higher CDPE scores had children with ^ 
fewer behavior problems. There was no ether child development 
rrutrnme variable for which the full regression model (containing 
f ige, -family bad-ground factors, center experience, and center 
-ji *!1+v) c*crciinted far a significant portion of the variance. 



step, children's age was the /only predictor of the measures of 
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Obviously, these r^feults were not expected. Previous resul ts 
have shown that day care quality is important -for all aspects of 
children's development. However the only, previous study as 
romprphensive as the present pilot study, was conducted in Bermuda 
where day care is nearly universal and instrument-based program 
monitoring is not in effect. Thus, the demographic factors found 
to characterize t heyday care centers in the present samp le and the 
r!*y care environment in the state of Pennsylvania may produce 
different relationships between program quality and children's 
develnament. The vali'e of a pilot study such as this is that these 
things are? discovered before the time and resources involved with 
* ste»te-wide effort, are committed. These data do not tell us that 
day care quality is not important for children's development. 
Thev do tMl us that a more sophisticated, design is needed for a 
future study. This pilot study was an important first step in 
identifying the variables that need to ije taken into account in 
future studies. 

A final word -of cautiqn is warranted. This pilot study 
involved only ten centers that were not randomly selected and were 
located in only one region of a very large state. Thus, the 
preliminary nature of the findings must be emphasized. The 
preliminary nature of the results preclude any public policy 
implications from being drawn. Implications for public policy 
awa it a ^ull-scale study. 

Ther^ were ten items on the ECERS scale that appeared to 
predict cverall quality of a program. These ten items (listed 
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b»low> had correlation coef f icients that ranged from .78 to .94 
with the total ECERS score. 

1. ECERS item 2, Personal care routines: meals/snacks 

Wei! balanced means/snacks are provided on a regular schedule. 
Staff member sits with children and provides pleasant social 
environment during meals and when possible at snacks. Small group 
size permits conversation. Time planned as a learning experience, 
including: self-help skills; talking about children's interests, 
?v9nt.B of the de.y, and aspects of foods (color and where foods 
come f r om) . 

2. ECER^ item 7, Furnishings/ plays furnishings (learning) 
Paste learning activity furr'shings plus woodwork bench and 

sand/water table. Easel or art table used daily; woodwork bench 
and send/water table used weekly. Full range of learning activity 
furnishings regularly used plus provision for appropriate 
i r dependent use by children. 

7. ECFRS item S, Furnishings/display: furnishings (relaxation) 

Planned cozy ares regularly available to children. Cozy area 
may bp used for reading, dramatic play, etc. Planned cozy area 
pUts "softness" avai2able in several other areas (examples, 
cushions in reading corner and doll house, several rug areas, 
manv **oft toys). 

4. ECERS item 9, Fur n i sh i ngs /d i sp 1 ay : room arrangement 

Three or more interest centers defined and conveniently 
equipped. Quiet and noisy centers separated. Appropriate play 
space provided in each center. Easy visual supervision of 
centers. Arrangement of centers designed to promote i ndependent 
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us* by children (example, labeled open shelves, convenient drying 
spare -for art work). Additional materials organized and available 
to add to or change centers. 

5. ECERS item 11, Language/ reason i ng : understanding language 
Many materials present -for free choice and supervised use. At 

least one planned activity daily (example, reading books to 
children, storytelling, -flannel board stories, -finger plays, 
etc.). Teacher provides good language model throughout the day 
(example, gives clear directions, uses words exactly in 
descriptions)- Plans additional activities -for children with 
^per.isl needs. 

6. ECERS item 15, Fine/gross motor: fine motor 

Variety of deve 1 opmen tal 1 y appropriate perceptual and fine 
motor materials in good repair used daily by children. Materials 
rotated to maintain interest; materials organized to encourage 
seM-helpt activities planned to enhance fine motor skills. 
?. ECFPS item 16, Fi.\e/gross motor: supervision 

Child given help and encouragement when needed. Teacher shows 
appreciation of children's work. Teacher guides children to 
materials on appropriate level for success. Teacher plans 
laming sequences to develop fine motor skills (example, 
provides chi 1 dren Jti.th puzzles of increasing difficulty, 
rt>-inging of larg* beads before small beads). 
. FCERS i tern 21 . Creative activities: art 

•-Individual expression and fr*e choice encouraged with art 
mat <=>r i c-*l «5 . Very few projects that are like an example are shown. 
Variety of materials avai lable for free choice, including three 
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dimensional materials (example, clay, art dough). Attempt to 
relate art activities to other experiences. 

9, ECEPS item 24, Creative activities: sand/water 
Provision -For sand and water play outdoors or indoors 

including toys (example, cups, spoons, -Funnels, shovels, pots 
and pans, trucks, etc.). Used at lease weekly. Provisions for 
sand and water play outdoors and indoors with appropriate toys. 

10, ECERS item 37, Adult needs: parent provisions 

Parent /sta-F-F information exchanged at regular intervals 
(example, through parent conferences, newsletter, etc.). Parents ^ 
mad* aware of approach practiced at facility (example, through 
information sheets, parent meetings, etc.). Parents welcomed to 
b» a part nf program (example, eat lunch with child, share a 
family custom with child's class). Provision of information on 
parenting, health care, etc. Parents' input regularly sought xn 
plpnnirg and evaluation of program. Parents involved in 
decisionmaking ^oles along with staff (example, parent 
representatives on board). 

Th?=p ten items correlate extremely highly with the overall 
program quality scores. In other words, centers that had higher 
t-} f a] FCERS scores, also tended to have higher scores on these ten 
i+err<=;, Thus, these items could be treated as program quality 
indicator items, similar to the items on the Indicator Checklist 
C 4 the CDPE. The CDPE as it is now designed is not discriminating 
^nr>ugh ir the program quality area. The addition of prugram 
ruiAMty indicators such as the above ECERS items would add dep^h 
«u«.b<=; t anre to a revision of the CDPE. 
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Conclusions 

The results of the pilot study provided information crucial 
to the successful design of a comprehensive, state-wide study of 
day care quality with public policy implications. The most 
important information gleaned from the pilot was the importance of 
samplirg center© in the comprehensive study. It may be necessary 
to obtain separate samples of prof it and nonprofit centers. It 
could be important to make sure there are middle class and lower 
class children included from each center involved so that center 
qualitv and soc i oeconcm i c status are not confounded. It will 
certainly be advantageous if the centers are randomly selected 
(•stratified by type) and a minimum of refusals occur. As a result 
nf the pilot ^tudy, the problem areas have been identified and are 
known* rather than unknowns when a comprehensive s^udy is begun. 

Pronram quality indicators must become part of Pennsylvania 
StAte Pav Care P<?gu la t i ons . Compliance with regulations as 
rprr.M-ed by the CDPE is not an indicator of program quality. There 
is vi^tviallv no linear relationship between program compliance and 
prr.cjrr.m q»irlity. In fact, it appears that as compliance scores for 
thn rer*pr= in the pilot study rose, program quality scores 
pcti-MJy drcpped off. Before program quality indicators can be 
inr^'jdpd in the regulations, a comprehensive study of day care 
rj'jMity must occur with a large, representative sample of 
r n s / ] van i a day care centers. 

Another critical variable that should be looked at closely in 
*h? CDPFCost study (now being undertaken by Dr. Fiene) is the 
-^founding of center quality and funding source (public versus 
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private -funding). The -fact that private programs were 
significantly lower in quality than public programs (as measured 
by th*? ECFRS) appears to have implications -for the CDPECost study. 
Has cosL had such an impact on t.he private programs that program 
quality has suffered? Have the private programs slipped down the 
cor.t/CDPE curve so significantly that program quality is in 
jeopardy? These questions should be explored in further detail vis 
the Cu°E-Cost study. 
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